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Abstract — A novel adaptive binary decoding algorithm for 
LDPC codes is proposed, which reduces the decoding complexity 
while having a comparable or even better performance than 
corresponding non-adaptive alternatives. In each iteration the 
variable node decoders use the binary check node decoders 
multiple times; each single use is referred to as a sub -iteration. 
To process the sequences of binary messages in each iteration, 
the variable node decoders employ pre-computed look-up tables. 
These look-up tables as well as the number of sub-iterations 
per iteration are dynamically adapted during the decoding 
process based on the decoder state, represented by the mutual 
information between the current messages and the syndrome 
bits. The look-up tables and the number of sub-iterations per 
iteration are determined and optimized using density evolution. 
The performance and the complexity of the proposed adaptive 
decoding algorithm is exemplified by simulations. 

I. Introduction 

Low-density parity-check (LDPC) codes together with mes- 
sage passing decoders are among the most powerful channel 
coding schemes known [1], [2]. They allow performance close 
to the Shannon capacity while the decoding complexity grows 
only linearly in the code length. Even though the decoding 
complexity of LDPC codes is already relatively low, it may 
still be too high for some high speed applications, e.g. fiber- 
optics. A further reduction of the decoding complexity leads 
usually to performance losses. Among the class of message- 
passing algorithms, the sum-product algorithm achieves the 
best performance but requires real-valued messages. In con- 
trast, bit-flipping algorithms pass only single-bit messages but 
also suffer poorer performance [3], [4]. 

In [5] we introduced a new type of binary message passing 
algorithm. The variable node decoders send binary messages 
to the check node decoders, which perform simple modulo-2 
addition. In each iteration, however, the variable node decoders 
may use the check node decoders multiple times, where each 
single use is referred to as one sub-iteration. The binary 
messages per sub-iteration are generated similarly to ideas 
in stochastic decoding [6]. In addition to that, the variable 
node decoders use pre-computed look-up tables to optimally 
process the bit messages in each iteration. All more complex 
computations are performed in the variable node decoders, 
which makes this decoding structure attractive for efficient 
high-speed implementations. 

For the analysis of this algorithm it is convenient to collect 



(for each edge) all binary messages of an iteration into a binary 
vector message. Therefore the algorithm is referred to as the 
binary vector message passing algorithm (BVMPA) [5]. The 
selection of the number of sub-iterations per iteration (which 
is equivalent to length of the binary vector messages) allows 
an easy trade-off between performance and complexity. In [5] 
the BVMPA is investigated for a fixed length of the binary 
vector messages. 

In the present paper we propose an extension of the BVMPA 
that reduces the complexity while keeping the same perfor- 
mance or even achieving better performance as compared to 
the original BVMPA. Both the look-up table and the number 
of sub-iterations per iteration are dynamically adapted to the 
current status of the decoding process, referred to as decoder 
state. The key contributions of the present paper to reduce the 
decoding complexity are: 

1) We define the measure syndrome information that is 
used to track the quality of the current message during 
the decoding process. This measure is considered as a 
decoder state with respect to the decoding process. 

2) We determine optimized look-up tables to be used when 
the decoder is in a certain state. 

3) We optimize the number of sub-iterations per iteration 
(vector lengths) to be used when the decoder is in a 
certain state. 

The optimum look-up tables and the optimum number of sub- 
iterations are determined using density evolution. Simulations 
show that bit error rates of 10~^ can be achieved with an 
approximate average of only 50 sub-iterations, i.e., the decoder 
converges with only 50 bits exchanged per edge. 

The concept of adapting the decoding process dynamically 
was also studied in [7] for a bit-flipping algorithm. The 
authors estimated an extrinsic error probability, and used it 
to dynamically adjust the bit-flipping threshold in the variable 
node decoders. In [8] the concept of "gear-shift decoding" 
was introduced where the decoder can select among a small 
set of available decoding algorithms (sum-product algorithm, 
min-sum algorithm, and bit-flipping algorithm) to reduce the 
decoding complexity. Both concepts will be incorporated in 
die BVMPA. 

The outline of the paper is as follows. In Section we 
introduce the system model and review the decoder structure. 
In Section |III] we introduce the concept of decoder states 



to track the progress of the decoding, and we explain how 
this can be used directly to improve the actual decoding. In 
Section HV] we address decoding with variable vector lengths, 
and optimize the vector lengths with respect to the decoder 
state. Simulation results for the resulting decoder structure are 
presented in Section IV] 

Throughout the paper, random variables are denoted by up- 
percase letters, and their realizations are denoted by lowercase 
letters. The indices v, c, a, and e stand for variable-node de- 
coder, check-node decoder, a-priori and extrinsic, respectively. 
We assume that the reader is familiar with standard knowledge 
about LDPC codes, see e.g. [9]. 

II. System Model and Decoder Structure 
A. System Model 

We consider regular [dy , dc) LDPC codes of code length N, 
where d„ denotes the variable node degree and dc denotes the 
check node degree. (The concepts can be extended to irregular 
LDPC codes). The codewords are assumed to be equiprobable 
and are transmitted over a memoryless symmetric communi- 
cation channel, e.g. an AWGN channel. 

Denote a code bit as X G {0, 1}, and the corresponding 
channel output as y. The L-values of the code bits given the 
direct observation are 



U:= L{X\y)^lii 



Pr(X = 0\y) 
Pr(X = l|y)- 



They are called channel L-values, and are provided as input 
to the LDPC decoder. 

B. Decoder Structure 

For decoding we employ the BVMPA introduced in [5]. 
In the following this algorithm is briefly reviewed, and the 
amendments proposed in the present paper are outlined. For 
details on the original BVMPA we refer the reader to [5]. 

The iterative decoder for the LDPC code operates on the 
factor graph of the code defined by a parity-check matrix H. 
The decoder iterates until the codeword estimate x is an actual 
codeword, i.e., until Hx = 0. 

The variable node decoders (VNDs) and the check node 
decoders (CNDs) exchange messages that are binary vectors 
b G {0,1}'^ of length Q. By definition, only the Hamming 
weight of the vector, w = WH{b), and not the positions of 
the ones within the vector, conveys information. Therefore 
the weight represents, in some sense, the probability that the 
corresponding code bit has the value one. 

The VND for a code bit X gets the channel L-value Ich and 
dy binary vector messages bavj, j = 1, dy from the CND. 
Each vector bav.j with weight Wavj is first converted into an 
L-value 



L{X\bav,j) = L{X\Wav,j) 



In 



p{Wav,j\X = 0) 



In- 



p{Wavj\X = 0) 



p{Wav,j\X = l) piQ - Wav,j\X ^ 0) 

= : fw2L{Wav.j,P{Wav,j\X = 0)). (1) 

For this conversion, we first use that only the vector weight 
is relevant, and then that the probability p{wav\X = 0) 



fulfils a certain symmetry property [5]. In the following we 
refer to this mapping from weights to L-values as the W2L 
mapping fw2L{wav,p{wav\X = 0)), where Wa^ is the weight 
of the vector message and p{'Wa.u\X = 0) is the conditional 
probability distribution of this weight given X ~ 0. Notice 
that this distribution changes over the decoder iterations. 

Using density evolution, the probability distributions 
p{'Wav\X = 0) for each iteration i can be pre-computed, and 
so can the W2L mappings. In this way we obtain iteration- 
dependent W2L mappings fw-ihi'^o.vii), as applied in [5]. 
(The index it stands for "iteration dependent".) Notice that 
the actual decoding process may not exactly follow the one 
predicted by density evolution, particularly for medium to 
short block lenghts, and thus the applied W2L mappings may 
not be optimal. This issue will be addressed in Section |III1 

The VND then adds these a-priori L-values to obtain the 
extrinsic L-value 

^ev^k ^ch ^ ^ ^ ^avj- (2) 

This L-value is converted into the corresponding probabiUty 
that the code bit has value one. 



Pcv^k ■■= Prix = 1\Ic,m) = (1 + e'^^-"] 



(3) 



The desired weight of the extrinsic message is obtained by 

Wev,k ■= TOVLl-ld{pcv,kQ), (4) 

where the function round(-) denotes rounding to integers. The 
actual vector bcv.k is then a random binary vector of length Q 
and weight ■Wcv,k [5]. This random element in our decoding 
algorithm shows similarities to stochastic decoding [6]. 

The CND gets dc binary vector messages bac.j, j = 
l,...,dc. The extrinsic messages are computed by a simple 
modulo-2 addition. 



be 



(5) 



In expectation this operation is optimal [6]. Notice that this 
vector addition is a bit-wise operation. For an efficient im- 
plementation, the CND may be a simple bit addition, like in 
binary message passing decoders, and the VND may use each 
corresponding CND Q times. In the following we refer to one 
of this binary operations as one sub- iteration. One iteration 
with message length Q thus corresponds to Q sub-iterations. 

The complexity of the BVMPA is proportional to the 
message length times the number of iterations, or equivalently, 
to the number of sub-iterations until convergence. Decoding 
of regular LDPC codes is only critical in the middle of the 
decoding process where the EXIT curves of the VNDs and the 
CNDs are close to each other. Correspondingly large vector 
lengths Q are usually not required at the beginning and at 
the end of decoding. By reducing the lengths of the messages 
when possible without loss in performance, the average num- 
ber of sub-iterations and thus the average decoding complexity 
is expected to be reduced. The optimization of the message 
lengths and their adaptation during the decoding process is 
addressed in Section HVl 



III. Decoder-state Dependent Decoding 

In the considered decoder structure, the W2L mapping from 
the weight of the vector message to the L-value at the VND 
input is not constant but changes over the iterations. In [5] 
the iteration number was used to parameterize this mapping, 
as given in ([T]i. The problem with this approach, however, 
is that an actual instance of the decoding process may not 
be accurately predicted by density evolution, particularly for 
medium or short block lengths. Thus the mapping used at a 
certain iteration number is likely to be suboptimal. 

Rather than using the iteration number to select the W2L 
mapping, we propose to use a measure that reflects the quality 
of the messages currently exchanged between the VNDs and 
the CNDs. Using this approach, the decoder selects the W2L 
mapping based on the current message quaUty, and thus adapts 
dynamically. 

A. Decoder State Based on Syndrome 

The decoder state has to be a value that can be measured in 
a real decoder without knowledge of the data transmitted. In 
[7] the extrinsic error probability was used in a similar context. 
We propose to measure information about syndrome bits that 
results from the assumption that the actual syndrome is not 
known. (Of course, the syndrome Hx is known to be zero for 
every codeword x.) We will first explain this idea for the case 
where the messages are L-values, and then for the given case 
where the messages are binary vectors. 

Consider a check node of degree dc corresponding to the 
code bits X„, n = 1, 2, . . . , dc- Define the syndrome bit 

S ■.= Xi®X2(B---(BXd^, (6) 

where by definition of the code, we know that = 0. Consider 
now the decoder for this check node. For the time being, 
assume that this CND obtains the a-priori L-values lac,n, 
n = 1,2, ... ,dc, for these code bits. (We will later come back 
to binary vector messages.) The extrinsic L-value for X^^ is 
computed as [10] 

lac,d^ ■= lac,l B lac,2 ffl ■ • • ffl lac,d^-l- (J) 

Define now 

h ■= lac,l ffl lac,2 ffl • • • E lac,da- (^) 

This L-value is obvioulsy the extrinsic L-value for the syn- 
drome bit 5*, as defined in (|6]l. It corresponds to the probability 
of S being zero or one given the a-priori L-values for the 
dc code bits (and excluding the knowledge that S is zero 
by definition of the code). In this setting with L-values, the 
probability for 5* being one can be used to define the decoder 
state. 

Consider now the case that the CND obtains the a-priori 
binary-vector messages bac,n, n = 1,2, ... ,dc, as in the al- 
gorithm employed in the present paper. The extrinsic message 
for Xd^ is computed as 

bac.d, ■■= bac,l ® bac.2 © ■ ' ■ © bacd.-l- (9) 

Similar to the case above with L-values, define now 

bs:=bac,iObac,20---®bac.d,. (10) 



This message is the extrinsic message for the syndrome bit S 
given the a-priori messages for the code bits (and excluding 
the knowledge that S is zero by definition of the code). 

These syndrome bit messages are now computed for all 
check nodes. By definition of the binary vector messages, 
only the weight of the vector conveys information but not 
the positions of the ones. Therefore we compute the weight 
of each vector, consider this weight as a random variable 
Ws, and determine the empirical weight distribution of the 
syndrome bit messages, denoted by pw, {w). As we know that 
the actual values of the syndrome bits are zero, this is in fact 
the conditional weight distribution given S* = 0. This can 
now be used to define a decoder state. Notice that this can 
be computed without knowledge of the transmitted data, as 
desired. 

The decoder state should be a scalar value, for convenience, 
and it should capture the information in the distribution that is 
relevant for the iterative decoding process. Motivated by that, 
we define the decoder state as 

Is := H{\{pwAw) + PwAQ ~ w))) - H{pwAw)). dD 

where H{p) denotes the entropy of the probability mass 
function p. The value Is is the average bit-wise mutual 
information between the syndrome bit and the weight of the 
syndrome message, under the assumption that the codewords 
are randomly chosen over all binary vectors. Given this 
interpretation, we refer to the decoder state defined in ( fTTI ) 
as syndrome information. 

B. Use of Decoder State in Decoding 

As outlined at the beginning of this section, the W2L 
mapping can now be made decoder-state dependent instead of 
iteration dependent. We use density evolution for the BVMPA, 
see [5], and extend it such that also the syndrome information 
is computed. (As this extension is straightforward, we omit 
the details here.) 

Using this extension, the W2L mapping can be determined 
for each syndrome information, where the values of the 
syndrome information Is are uniformly quantized for practical 
reasons. We denote these mappings by f^^hi'^^^s), where 
w denotes the weight of the extrinsic binary vector message 
obtained by the VND, and Is is the current value of the 
syndrome information. (The index ds stands for "decoder 
state".) 

These mappings are given to the LDPC decoder as a pre- 
computed look-up table. During the decoding process, the 
syndrome information is computed in each iteration, and the 
corresponding W2L mapping is applied. The computational 
overhead to compute the syndrome information is negligible 
as this has to be done only once per iteration (once per Q sub- 
iterations). In addition to that, the value of Q is relatively small 
in the relevant cases, and so the look-up tables are relatively 
small as well. 

Besides using the syndrome information to allow the de- 
coder to select the best mapping, we also use this quantity as 
an additional stopping criterion, i.e. the decoder stops iterating 
and declares an error if the syndrome information is not 
improved within a given number of iterations. 
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Fig. 1: Bit error rate of a (3,6) LDPC code of length 
N ~ 1000 for message lengths Q ~ 10 with iteration 
dependent W2L mappings and with decoder-state dependent 
W2L mappings. 
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Fig. 2: Number of sub-iterations (complexity) of a (3, 6) LDPC 
code of length N ~ 1000 for message lengths Q = 10 
with iteration dependent W2L mappings and with decoder- 
state dependent W2L mappings. 



The effect of this approach is exemplified with simulation 
results for a (3,6) LDPC code of length N = 1000 for 
message lengths Q = 10. We compare decoding with iteration 
dependent W2L mappings [5] to decoding with decoder-state 
dependent mappings. For the iteration-dependent case, the 
look-up table comprises one row per iteration (100 in our 
example). For the decoder-state dependent case, however, the 
look-up table comprises only one row per quantized syndrome 
information, where 20 quantization levels turned out to be 
sufficient. Regarding the stopping criterion, the LDPC decoder 
terminates if the syndrome information has not increased over 
the previous 10 iterations. 

Fig. [T] shows the resulting bit error rates. The decoder-state 
dependent approach leads to a better performance over the 
whole SNR range. The average number of sub-iterations is 
depicted in Fig. |2] Here, the improvement of the decoder-state 
dependent approach is even more significant. For low SNR, 
the additional stopping criterion reduces the average number 
of iterations while for high SNR, the decoder-state dependent 
selection of the mapping leads to a faster convergence. 

IV. Message Length Optimization 

In the previous section we reduced the average number of 
sub-iterations and thus the decoding complexity by employing 
decoder-state dependent W2L mappings. In this section we 
further reduce the decoding complexity by using the smallest 
message lengths possible without deteriorating performance as 
compared to the BVMPA with corresponding fixed message 
length. 

The motivation is similar to the one in the previous sec- 
tion. As previously discussed, only "the middle part" of the 
decoding process is critical for convergence and thus requires 
messages of higher precision, whereas shorter messages are 
typically sufficient in the beginning and the end of the decod- 
ing process. 

In the following we optimize the message lengths using 
density evolution. The LDPC decoder then selects the required 



message length during the decoding process based on the 
decoder state. 

A. Method 

Consider the decoding structure described in Section HIl but 
with an additional degree of freedom; the length Q of the 
binary vector messages is not fixed but may change over 
iterations. Denote Qi the message length used at iteration i, 
and denote Qmax the maximum message length. 

The optimization problem is then: determine the sequence 
of message lengths Q = [Qi, (52, Qa, • • •] such that the overall 
number of sub-iterations, Qj, is minimized for successful 
decoding {1$ = 1). 

A complete search is obviously not feasible and thus, 
simplifying assumptions are required. In the following we 
develop a trellis-based method similar to [8] to solve this 
problem. First we define the cost function 

i 

c^ = Y,Qj, (12) 

for the path Q^ = [Qi, Q2, ■ ■ ■ , Qi\ of length i; i.e. a path 
corresponding to i iterations and a total of Ci sub-iterations. 
Consider now the tree representing all possible sequences Q. 
Assume that the tree has been completely searched up to a 
certain depth i. Then at this depth there may be paths that 
have the same syndrome information but different costs. In 
the EXIT chart method it is usually assumed that the mutual 
information represents the most important parameter of a 
probability distribution. Following this idea, among the paths 
that have the same syndrome information, we keep only the 
one with the least cost, and discard the other ones. 

As the syndrome information is a real value, it is unlikely 
that many paths will have exactly the same value. To further 
reduce the search complexity, we quantize the syndrome 
information, and refine the above selection criterion. Among 
all paths (at the same depth) that have the same quantized 
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Fig. 3: Bit error rate of the (3, 6) LDPC code for static message 
lengths Q = 10 and for dynamic adaptive message lengths 

Q < Qmax = 10. 
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Fig. 4: Complexity in terms of the number sub-iterations of 
the (3,6) LDPC code for static message lengths Q = 10 and 
for dynamic adaptive message lengths Q < Q„iax = 10. 



syndrome information, we only keep the one with the least 
cost. 

Using these simplifications, it is straightforward to solve 
the optimization problem with a trellis-based search, where 
the trellis states are the quantized values of the syndrome 
information. With a sufficient large number of quantization 
levels, the resulting path Q* can be expected to be very close 
to the optimum one. For convenience, we simply refer to Q* 
as the optimum path. 

B. Application in Decoder 

The optimized message lengths are applied in the actual 
LDPC decoder similarly to the W2L mappings, using density 
evolution. For each message length Qi the corresponding syn- 
drome information Is is determined. Inverting this mapping, 
we obtain the function fqils) that determines the message 
length Q for the syndrome information Is - Similarly as before, 
but now for varying message lengths, the W2L mappings 
fw2L{'^J) are determined. 

The two functions /q^(/s) and fw2Li'^i -^s) are given to 
the LDPC decoder in form of pre-computed look-up tables. 
After each iteration, the decoder then determines the current 
value of the syndrome information (see Section HIIl i. and 
based on that, it determines the message length and the W2L 
mapping to be used in the following iteration. 

V. Simulation Results 

In this section we demonstrate the performance of the 
proposed algorithm with a specific example. We consider a 
(3, 6) LDPC code of length N = 1000 with g,„ax = 10. In the 
following we compare the decoder-state dependent approaches 
with fixed message length of Q = Qmax and variable message 
length Q < Qmax- A quantization of Is to 20 levels turned 
out to be sufficient. 

Fig. [3] shows that the BER for the variable length case is 
only slightly deteriorated compared to the fixed length case. 
The target of the approach is to reduce the average number 
of sub-iterations, and thus reducing the decoding complexity. 



Fig. |4] shows that the average number of sub-iterations of the 
variable length algorithm is below the fixed length case as 
expected. 
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